1/30 



22 



EQUIPMENT HARDWARE RESOURCES 

PROCESSING DEVICE (E.G., CPU, PROCESSOR, ETC.) 
STORAGE DEVICE (E.G., RAM, ROM, CACHE, HARD DISK, ETC.) 
OUTPUT DEVICE (E.G., PRINTER, MONITOR, PLOTTER. ETC.) 
SCANNING DEVICE (E.G., SCANNER, SLIDE SCANNING DEVICE, ETC.) 
INPUT/OUTPUT DEVICE (E.G., FLOPPY DRIVE, NETWORK CONNECTION, ETC.) 



EQUIPMENT SOFTWARE RESOURCES 



OPERATING SYSTEM 

DEVICE DRIVERS 

IMAGE ANALYSIS APPLICATION 
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FIG. 1 
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FIG. 2 
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NEXT POINT 
(E.G., PIXEL) 
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F/G. 3b 
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F/G. 3e 
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START FROM A PIXEL IN 
THE IMAGE (E.G., THE 
PIXEL IN THE UPPER-LEFT 
CORNER OF THE IMAGE) 



EXAMINE PIXELS SEQUENTIALLY TO 
FIND A CURRENT PIXEL HAVING A 
DESIRED INTENSITY (E.G., A 
CURRENT PIXEL HAVING AN 
INTENSITY THAT IS APPROXIMATELY 
ABOVE A THRESHOLD INTENSITY) 



THE CURRENT PIXEL HAS 
THE DESIRED INTENSITY 



262 



IDENTIFY THE CURRENT PIXEL TO BE PART OF A NEW 

OBJECT OR PART OF A KNOWN OBJECT BASED ON 
PARTICULAR ADJOINING PIXELS (E.G., TWO ADJOINING 
PIXELS THAT WERE ALREADY EXAMINED, ONLY TWO 
EXAMINED PIXELS THAT ARE ADJACENT TO THE 
CURRENT PIXEL, ETC.) 262b 
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IDENTIFY THE 
CURRENT PIXEL TO 
BE PART OF A 
KNOWN OBJECT 
WHEN AT LEAST ONE 
OF TWO ADJOINING 
PIXELS IS KNOW TO 
BE PART OF THE 
KNOWN OBJECT 



IDENTIFY THE 
CURRENT PIXEL TO 
BE PART OF A NEW 
OBJECT WHEN 
NEITHER ONE OF 
THE ADJOINING 
PIXELS ARE 
DETERMINED TO BE 
PART OF AN OBJECT 



FIG. 3f 



5/30 



40 S 



NEW SPOT 

F/G. 4a 
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KNOWN SPOT 

F/G. 4/5 
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F/G. 4c 
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TWO KNOWN SPOTS 

F/G. 4c/ 
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LIGHT INTENSITY RANGE 
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F/G. 4f 
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FIG. 5e 



FIG. 5f 
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START FROM A PIXEL IN 
THE IMAGE (E.G., THE 
PIXEL IN THE UPPER-LEFT 
CORNER OF THE IMAGE) 



EXAMINE PIXELS SEQUENTIALLY TO 
FIND A CURRENT PIXEL HAVING A 
DESIRED INTENSITY (E.G., A 
CURRENT PIXEL HAVING AN 
INTENSITY THAT IS APPROXIMATELY 
ABOVE A THRESHOLD INTENSITY) 



THE CURRENT PIXEL HAS 
THE DESIRED INTENSITY 
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IDENTIFY THE CURRENT PIXEL TO BE PART OF A NEW 
OBJECT AND SEARCH RECURSIVELY STARTING FROM 
THE CURRENT PIXEL TO FIND OTHER PIXELS THAT ARE 
PART OF THAT NEW OBJECT (E.G., SEARCH OUTWARD 
REPEATEDLY FROM EVERY PIXEL THAT HAS A DESIRED 
INTENSITY TO FIND SUBSTANTIALLY ALL OF THE PIXELS 
THAT ARE PART OF THE NEW OBJECT) 



F/G. 5g 
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EDGE REJECTION 

FIG. 6a 
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FIG. 7b 
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DETERMINE SUM OF 
INTENSITIES IN EACH 
REGION 



IDENTIFY A REGION TO 
INCLUDE AN OBJECT (E.G., 

A SPOT) BASED ON THE 
INTENSITY SUM FOR THAT 
REGION 



SET THE INTENSITY SUM 

FOR REGIONS THAT 
OVERLAP THE IDENTIFIED 
REGION TO ZERO 



FIG. 8a 
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DETERMINE AN INTEGRATED INTENSITY 
FOR EACH OF A PLURALITY OF 
REGIONS IN THE IMAGE 
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SORT THE INTEGRATED INTENSITIES 
FOR THE REGIONS IN DESCENDING 
ORER 



CLAIM SOME OF THE REGIONS TO CONTAIN 
SPOTS BASED ON DETERMINING THE HIGHEST 
INTEGRATED INTENSITY AMONG THE REGIONS 
WHILE SETTING THE INTEGRATED INTENSITIES 

FOR THE REGIONS THAT OVERLAP EACH 
CLAIMED REGION TO A DESIRED INTENSITY (E.G.. 
ZERO INTENSITY) 



FIG. 8b 
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FIG. 9 



APPLY THRESHOLDING IN A 
PORTION OF A REGION (E.G., A 
REGION USED IN INTEGRATION) 

DETERmTnE a TH'rESHOLD RANGE 1 

f'OB™f^'!J!?!l \ 



110^ DETERMINE THE BEST OBJECT (E.G. 

BEST SPOT) IN THE REGION 



THE 
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DETERMINE CHARACTERISTICS OF THE 
BEST OBJECT 



FIG. 10 
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APPLY 
THRESHOLDING 
^ ^ 
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F/G. -/la 




DETERMINE 
CHARACTERISTICS 

OF SPOTS 
(E.G., 
SIZE) 
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DETERMINE WHETHER 
TO DISCARD BASED ON 
CHARACTERISTICS 



DISCARD REGION BASED ON A 
PARTICULAR CHARACTERISTICS OF THE 
SPOTS, SUCH AS SIZE (E.G.. DISCARD BY 
SETTING THE INTENSITY FOR THE 
REGION TO BE ZERO, DISCARD BY 
IGNORING THE REGION, ETC.) 



F/G. 11c 
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FIG. 12a 



APPLY 

THRESHOLDING 
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DETERMINE 
CHARACTERISTICS, 
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FIG. 12b 
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DETERMINE WHETHER TO 

USE BASED ON 
CHARACTERISTIC SUCH 
AS DISTANCE 



II 
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DISCARD BASED ON CENTER 
OF REGION NOT BEING 
WITHIN SOME MINIMUM 

DISTANCE OF SPOT CENTER 



FIG. 12c 
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MOVE REGION TO 
BE CENTERED ON 
CALCULATED 
SPOT CENTER 
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FIG. 13d 



FIG. 13b 
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MOVE REGION TO BE 
CENTERED ON CALCULATED 
SPOT CENTER 



FIG. 13c 



MOVE REGION TO CENTER ON 
DETERMINED OBJECT CENTER | 
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YES ^150 


DETERMINE WH 
CENTER IS CO 
OBJECT CENTE 
NUMBER OF 


ETHER REGION 
NVERGINGTO ^ 
R (E.G.. BY THE 
ITERATIONS) 



IDENTIFY THAT A REGION THAT 
INCLUDES A TYPE OF OBJECT 



DETERMINE A CENTER FOR 
THE OBJECT IN THE REGION 
(E G., USING THRESHOLDING) 



.NO 



DETERMINE IF REGION CENTER 
IS WITHIN TOLERANCE OF 
OBJECT CENTER 



FIG. 14 
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YES 



STOP 
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FIG. 15 
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DETERMINE AVERAGE 
INTENSITY PROFILE 
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APPLY INTENSITY PROFILE 
TO REGIONS IN LOCATING 
OBJECTS (E.G., REPEAT 
INTEGRATION USING 
PROFILE, ETC.) 



FIG. 16 
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DETERMINE REGIONS THAT 
INCLUDE A TYPE OF OBJECT 
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PART OF AN 
IMAGE 



AVERAGE LIGHT INTENSITY OF 
POINTS THAT ARE IN THE SAME 
LOCATION IN EACH REGION 



INTENSITY 
PROFILE OF AN 
AVERAGE OBJECT 



F/G. Ma 
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#111111111111111111111111111 
#111111111111111111111111111 
#111111111111111111111111111 
#111111111122333322111111111 
#111111112344555544321111111 
#111111234566777766432211111 
#1 1 1 1 12346678877777654221 1 1 1 
#1111 23466789877777765421 1 1 1 
#1111 245677777666677765321 1 1 
#1 1 124666665555556667776421 1 
#1 1 124666655665555667776421 1 
#1 1235676655666555666777531 1 
#1 1 1 35676665566555666776431 1 
#1 1 1 34676666555556667776421 1 
#1 1 124677666555566677776421 1 
#1 1 123577766666666777775321 1 
#1 1 1 1246777777777777776431 1 1 
#1 1 1 1235677777777777765321 1 1 
#11111 2467788888877765421 1 1 1 
#1 1 1 1 1224567777777765421 1111 
#111111 1234566666654321 11111 
#111111 1 12233444443221 111111 
#111111111112222222111111111 
#111111111111111111111111111 
#111111111111111111111111111 



FIG. 17b 
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DETERMINE WHERE SPOTS 
ARE LOCATED (E.G., USING 
THRESHOLDING. 
INTEGRATION. ETC.) 



174 



DETERMINE RELATIONSHIP OF 
GRID POINTS THAT FORM A 
GRID THAT WAS USED IN 
PLACING SPOTS 



MAP SPOTS TO GRIP POINTS 
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FIG. 18 
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FIG. 20 
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DETERMINE A PLURALITY 
UNIT CELL SPOT PITCH 
VECTORS 



DETERMINE AN ACTUAL 
UNIT CELL SPOT PITCH 
(E.G., AVERAGE OF UNIT 
CELL SPOT PITCH 
VECTORS) 
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DETERMINE RELATIONSHIP 
OF GRID POINTS TO EACH 
OTHER BASED ON ACTUAL 
SPOT PITCH 



198 



DETERMINE A UNIT CELL 
SPOT PITCH VECTOR FROM 
A CURRENT SPOT TO A 
NEAREST NEIGHBORING 
SPOT (E.G., NEAREST SPOT 
TO THE RIGHT) 
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DETERMINE WHETHER THE r 202 
LENGTH OF THE VECTOR IS " 
WITHIN TOLERANCE 



F/G. 22 



F/G. 21 
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NEAREST NEIGHBOR WITHIN 
TOLERANCE FOR SPOT PITCH VECTOR 




FIG. 23a 



NEAREST NEIGHBOR NOT WITHIN 
TOLERANCE FOR SPOT PITCH VECTOR 




FIG. 23b 
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DETERMINE LOCATIONS OF SPOTS 
IN ROWS AND COLUMNS 



DETERMINE PAIRS OF SPOTS TO 
USE IN DETERMINING AN AVERAGE 
SPOT PITCH VECTOR BASED ON 
WHICH ROW (OR COLUMN) THE 
SPOTS ARE LOCATED IN (E.G., SORT 
SPOTS BASED ON ROWS AND 
DETERMINE PAIRS BASED ON 
LOCATION OF ROWS FOR SPOTS) 



FIG. 24 
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MAP GRID POINTS TO SPOTS BASED 
ON A DETERMINED SPOT PITCH 



DETERMINE SUBGRIDS OF THE GRID 



DETERMINE WHICH SPOTS HAVE 
BEEN MAPPED TO SUBGRIDS 



DETERMINE A SUBGRID SPOT PITCH 
BASED ON WHICH SPOTS ARE IN 
THAT SUBGRID 



MAP GRID POINTS TO SPOTS BASED 
ON SUBGRID SPOT PITCH VECTORS 
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FIG. 25 
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PROVIDE A SLIDE HAVING A HIGH 
DENSITY ARRAY OF SPOTS THAT 
INCLUDES MATERIALS FROM A 
PLURALITY OF SOURCES (E.G., 
CANCEROUS AND NONCANCEROUS 
TISSUE WITH A DIFFERENT 
FLUORESCENT TAG FOR EACH) 
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GENERATE IMAGES BASED ON THE 
SLIDE (E.G., A DIFFERENT IMAGE 

BASED ON CHARACTERISTICS OF 
EACH FLUORESCENT TAG) AND 
LOCATE SPOTS IN EACH IMAGE 
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ALIGN IMAGES BA! 
OF SPOTS (E.G.. 

TRANS 


3ED ON LOCATION 
USING A MATRIX 
.FORM) 



F/G. 26a 




F/6. 27a 





F/G. 27b 
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DETERMINE A COMPOSITE IMAGE 
(E.G., COMBINE LIGHT INTENSITY OF 
PIXELS IN EACH IMAGE THAT ARE IN 
A SAME LOCATION) 
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LOCATED SPOTS IN THE 
COMPOSITE IMAGE 
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ANALYZE SPOTS IN THE ALIGNED 
IMAGES BASED ON LOCATIONS OF 
SPOTS IN THE COMPOSITE IMAGE 



FIG. 26b 




FIG. 27d 




FIG. 27e 




FIG.27f 



28/30 



^300 

OBTAIN IMAGE INFORMATION (E.G., 
LOCATION, SIZE, SHAPE. SPACING 
MORPHOLOGICAL CHARACTERISTICS, 
ETC.) OF A NEW SUBJECT OF CONCERN 
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APPLY INFO. FROM IMAGE TO AN 

APPROPRIATE DATABASE OF 
INFORMATION (E.G., DATABASE OF 
INFORMATION ABOUT KNOWN SUBJECTS) 
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PROVIDE AN IDENTIFICATION FOR, A 
NATURE OF, A QUALITY OF, A 
CHARACTERISTIC OF, ETC. OF THE NEW 
SUBJECT (E.G., DISPLAY IDENTITY OF NEW 
SUBJECT) 



F/G. 28 
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